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ABSTRACT 

The purpose of this study was to examine the effects of a 
test-taking training given to Hispanic students on the reliabil- 
ity and predictive validity of a mathematics predictor test. 
The sample consisted of 535 ^efhtrering Hispanic college students. 
Of these, 241 completed most of their education In the United 
States and had prior familiarity with multiple-choice tests, 
while 294 students had received most of their education outside 
of the United States and were unfamiliar with the multiple- 
choice test format. The' students w^e randomly assigned to the 
experimental or control group. Students in the experimental 
group were instructed on those skills outlined by Millman, 
Bishop and Ebel (1965) which are independent of the test con- 
structor. Control subjects received information on the collegers 
mathematics programs for an equivalent period of time. All sub-, 
jects were administered the computation scale of the College 
Guidance and Placement Program (CGP) . Based on the results of 
the predictor test, subjects were placed in either m Basic Skills 
or Algebra course. A total of 159 subjects completed the courses 
Results showed slightly lower Internal consi61:ency estimates for 
the experimental group and an increase in predictive validity for 
experimental subjects. The increase was significant for the to- 
tal group In the Basic Skills course (p<.05) and the Algebra 
course (p<. 01). When the groups were divided on the basis of 
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where the students had received most of their education (United 
States vs, outside the United States), the difference in validi- 
ty coefficients was significant for the group of students edu- 
cated in the United States in the Basic Skills course only* 



INTRODUCTION 

The adequate use of standardized tests as a mean of assess- 
ment for Hispanic students has been highly questioned. Tradi- 
tional instruments fail to recognize the lack of familiarity of 
many Hispanic students witJi test format^ particularly those who 
have been educated outside the United States. Many Hispanic stu- 
dents do not appear to have the test-taking skills necessary to 
be properly evaluated. 

An increasing interest in test-taking skills or testwise- 
ness is evident in numerous recent studies on test characteris- 
tics that relate to it (Kuntz^ 1982)^ and also in publications 
designed to instruct students in this skill CDobbin. 1981; Hills » 
1981). Studies have focused primarily on the extent to which 
certain instruments are susceptible to testwise influences and 
the extent to which these skills can b? taught. Most studies 
have compared mean performance of trained versus untrained groups 
and have reported significant results (Dreisbach and Keosh^ 1982; 
Frierson^ 1977; Gaines and Jongsma, 1974). 

Smith (1982) has proposed a cognitive model of test-taking 
strategies. According to his model, testwisene^s is invoked when 
an examinee is unable to respond to an item because of lack of 
knowledge. In this situation, getting an item correct, althou^ 
the examinee lacks knowledge, would seem to decrease the validity 
of the measure. A second test-taking situation should be consi- 
dered in any specification of testwiseness. That is, an. examinee 
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may get an item incorrect because he or she lacks familiarity 
with item/test format^ although knowledge of the item may be pre- 
sent. In this case then^ getting the item correct would in- 
crease validity. There is empirical evidence to suggest that 
certain student feubpopul^tions lack familiarity with standard 
testing procedures and profit from training in these skills 
(Arroyo » 1981). These two situations are implied in the classi- 
fication" of testwiseness proposed by MilLman et al. , (1955). It 
is the second sitilation which is the focus of the present study. 

The purpose of this study was to investigate the extent to 
which the test-taking instruction of Hispanic college students 
affects the psychometric properties of a test. More specifical- 
ly» it sought to discover the effects of test-taking training on 
Hispanic college students who had received most of their educa- 
tion either in or outside of the United States relative to the 
reliability and predictive validity of a mathematics predictor 
test. 

METHOD 

Sample 

The sample consisted of 535 Hispanic entering college stu- 
dents from Miami-Dade Community College, New World Center ^who 
took the required basic skills assessment. Of these students 43% 
were male, and S7% were female. Subjects were randomly assigned 
to either a control or an experimental group within each of the 
testing sessions available at the college. Groups consisted of 
an average of 35 students. 



Procedures 

Groups vere taken into separate rooms for testing. Ini- 
tially^ both groups were given a background information form to 
be completed and a letter of informed consent. The experimental 
group met for thirty minutes prior to the administration of the 
College Guidance Placement Battery (CGP). During this time, stu- 
dents were trained in test-taking skills using the outline of 
testwiseness principles piX)posed by Millman et al. , (1965) . The 
first component of the outline which deals with elements inde- 
pendent of test constructor or test purpose was used. 

Each student in the experimental group received a booklet 
containing instructions on test-taking strategies. The experi- 
menter read and explained the instructions. Brief examples were 
discussed. At the end of instruction, a short practice test in 
test-taking principles was given to the students. The practice 
test consisted of ten questions similar in format (multiple- 
choice) to the questions in the predictor test (CGP) . After the 
students solved the problems, the experimenter explained the cor- 
rect approach. Questions were answered. The control group par- 
ticipated in a thirty-minute orientation session. They were in- 
formed about the different educational programs that the college 
offers. After the thirty-minute pretraining or orientation ses- 
sions, the college testing department administered tJte CGP. 

Students were placed in the mathematics courses according 
to the scores obtained in the computation scale of the CGP. 
Those students who obtained a score of 21 or hi^er were placed 
in Introductory Algebra, students who obtained a score below 2L, 
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were placed in Basic Skills. If a student wished to take a more 
advanced course, the student had to take another test. Some stu- 
dents took this Option. > 

Introductory Algebra and Basic Skill classes weire taught 
by instructors assigned by the chairperson of the Natural 
Science Department. Students selected their class scli^dules so 
control ^nd experimental- groups were no longer separated. All 
classes used the same textbook and all instructors followed the 
same competency statements. ^ 

Instruments 

T7ie predictor test used in this study, tlie College Guid- 
ance and Placement Program (CGP) , Computation, takes twenty min- 
utes and consists of 3S four-choice questions. It is concerned 
primarily with basic arithmetic operations on whole numl^ers, 
fractions, decijnals, and percents. A satisfactory score on the 
test could indicate a student ^s readiness to enter any course 
whose only mathematics prerequisite is com{)utational skills. A 
low score mi^t point out a need for developmental work in basic 
arithmetic. 

To establish predictive validity, the (Criterion used was 
final exam grade. The criterion tests were a common effort of 
the instructors teaching the courses in Basic Skills o|r Intro- 
ductory Algebra. These two exams were comprehensive and used a 
short-answer item format. Students were given sufficient time 
to finish. Internal consistency estimates using KR21 for the 
Basic Skills Exam was .62, while that for the Introductory 



Algebra Exam was ,66, Since KR21 assumes equal difficulty of 
items and that could not be verified for this study, these esti- 
mates are likely to be underestimates. 

Analysis 

KR20 reliability estimates were computed for the CGP for 
the experimental and control groups separately. Additionally, 
coefficients were computed for subjects educated outside of the 
United States separately from subjects educated in the United 
States, To determine predictive validity, correlation coeffi- 
cients were obtained between CGP scores and the scores obtained 
iij the coraprehensive final exam for each of the groups. Tliis por- 
tion of the analysis was based on smaller samples due to attri* 
tioi in the Algebra and Basic Skills classes. Fisher's r to z 
trans^formations were used to test the significance of the differ- 
ence bettifeen the validity coefficients of the experimental and 
control groups. ' 

Results 

Means and standard deviations are reported in Table 1. 



Insert Table 1 about here 



Overall, experimental subjects scored higher than control sub- 
jects. Tills difference was significant for the Hispanic students 
who had received much of their education in countries other than 



the United States. The result is in agreement^ith previous stu- 
dies involving other Hispanic populations (Dreisbach and Keosh, 
1982; Bernal, 1977; Frierson, 1977; Gaines and Jongsman, 1974). 
For Hispanic students educated in the United States, control sub- 
jects showed a higher mean, althou^ this difference was non- 
significant. 

Table 2 shows the reliability coefficient of the predictor 
test (CGP) for each of the groups. These results show that the 
training affected the reliability coefficient of the predictor 
test only slightly. 



Insert Table 2 about here 



Table 3 shows the number of students in the groups who com- 
pleted the Basic Skills and Algebra courses. Hie rate of attri- 
tion for subjects in this study was not unlike that conrronly ob- 
served in these courses, and did not differ significantly between 
experimental and control groups. 

Insert Table 3 about here 



Also shoivn in Table 3 are the correlations between the CGP and 
the final exam for each course separately. These correlations 
were computed by group. 
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Correlations between CGP test scores and final grade were 
higher in the experimental groups. This difference was signifi- 
cant for the total group in the Basic Skills course (p<w05) and 
the Algebra course (p-^.Ol). When the groups were divided on the 
basis of where the students had received most of their education 
(United States vs. outside the United States), the difference in 
validity coefficients was significant for the group of students 
educated in the United States in the Ba^sic Skills course only. 
Tlie small stunple sizes involved in subgroup comparisons are like- 
ly to be responsible for the lack of significance. 

CONCLUSIONS 

Several studies have suggested that Hispanic students lack 
the nt'oessary test- taking skills for adequate evaluation witJi 
standardized tests (Arroyo, 1982; Ginther, 1978). It has also 
beer i)iOwn that training Hispanic students on test-taking %kills 
has helped these students Ijnprove their test scores. A study by 
Ginther (1978) , indicated that training Hispanic students on 
parallel-test items increased the, reliability and predictive va- 
I lidity of specific instruments. ^Although in her study students 

were not specifically trained in test-taidLng principles, it 
seemed to indicate that a specific psychometric property of the 
instrument had been modified by the treatment. The findings of 

the present study were in agreement with those of Ginther 

) 

(1978). 

Although reliability was bosically unaffected, the 
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predictive validity of the instrument' increased for Hispdic etu 
dents in the experimental group. 

The results of the study indicate that^ Hispanic students 
can profit from a short training In these skills. Ihey also in- 
dlcate that the psychometric properties of the instriiments used 
to evaluate Hispanic students may be improved by trailing pro- 
vided to the students. These results are important to anyone in 
volved with the education, placement, and admission to pro-ams, 
colleges, and universities of Hlspajnlc students. Fu|rther repli- 
cations are recommended, since the sample sizes involved in the 
computation of validity coefficients were small. However, the 
consistency of results between the two courses investigated here 
would seem to Indicate that these findings are replicohlc in 
similiar populations. 
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TABI£ 1 

♦ 

■>■ MEANS AND- STANDARD DEVIATION^ OF CGP 

BY. GROUP 



Control. 



Experiment jil 



Group 1 
Group #2 
Total 



Mean 
Score 



20.325 
17:948 
19.010 



Standard 
iJeviation 



6.269 
6.857 
6.803 



Mean 
Score 



Standard 
Deviation 



18.386 
21.324 
20.013 



5:750 
6.595 
6.430 



Group 1 Hispanic students educated in the United States 
Group 2 Hispanic students educated outside the United States 



TABI£ 2 

CGP RELIABILITY COEFFICIENTS (KR20) 
BY GROUP 



Control Experimental 

Number of Reliability Number of Reliability 
Students Coefficient Students Coefficient 



Group 1 im .855 127 .815 

Group 2 124 .890 - 170 .865 

.855 



^Total 238 .889 297 



Group 1 
Group 2 



Hispanic students educated in the United States 
Hispanic students educated outside I3ie United States 



' TAB I£ ■ 3 

CORREIATIONS BETWEEN SCORES ON PREDICTOR 
TEST AND SCORES ON FINAL EXAM 







Basic Skills 




Introductory Algebra 




N 


Control 


N ' 


Experi- 
mental 


N 


Control 


N 


Experi- 
mental 


Group 1 


15 


.281 


22 


.740* 


22 


.355 


16 


.615 


Groi4p 2 


26 


.476 


22 


.603 


20 


.112 


16 


.4a2 


Total 


41 


.390 


44 


.671* 


42 


' .131 


32 


.663** 



Group 1 Hispanic students educated in the, United States 

« 

Group 2 Hispanic students educated outside the United States 

* p<f05 
** P<.01 

ft 
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